Depth Driven Photometric and Geometric Image Registration for Real-Time Stereo Systems
نویسندگان
چکیده
This paper presents a novel depth driven approach for a highly accurate joint photometric and geometric image alignment. Thereby, the registration problem is expressed in terms of a consistent, elegant and efficient energy formulation. Moreover, we propose a real-time capable alternating iterative optimization scheme to solve for a state of minimal energy. Since our energy formulation is based on pixel wise color similarity our registration procedure directly improves the performance of disparity estimation and the visual quality of multi-view view synthesis.
منابع مشابه
New Pseudo-CT Generation Approach from Magnetic Resonance Imaging using a Local Texture Descriptor
Background: One of the challenges of PET/MRI combined systems is to derive an attenuation map to correct the PET image. For that, the pseudo-CT image could be used to correct the attenuation. Until now, most existing scientific researches construct this pseudo-CT image using the registration techniques. However, these techniques suffer from the local minima of the non-rigid deformation energy f...
متن کاملA Practical Approach for Super-Resolution using Photometric Stereo and Graph Cuts
In this paper, we propose an approach to obtain super-resolved image and super-resolved depth map using photometric cue. The images are captured using different light source positions which are assumed to be known. The surface of the object is assumed to be Lambertian. We model the high resolution structure (surface gradients) as a Markov Random Field (MRF) and use graph cuts with discontinuity...
متن کاملIntegration of Real and Virtual Light Sources in Augmented Reality Worlds
A number of issues need to be taken into consideration for the output of an augmented reality application to appear realistic. Such issues include the level of detail of the virtual scene, the accuracy of alignment between the two worlds and the correspondence of illumination between the real and virtual components. This paper reviews geometric registration techniques that are commonly used to ...
متن کامل3D single-pixel video
Photometric stereo is an established three-dimensional (3D) imaging technique for estimating surface shape and reflectivity using multiple images of a scene taken from the same viewpoint but subject to different illumination directions. Importantly, this technique requires the scene to remain static during image acquisition otherwise pixel-matching errors can introduce significant errors in the...
متن کاملRegistration and Segmentation for 3D Map Building: A Solution Based on Stereo Vision and Inertial Sensors
AbstructThis article presents a technique for registration and segmentation of dense depth maps provided by a stereo vision system. The vision system uses inertial sensors to give a reference for camera pose. The maps are registered dsing a modified version of the ICP Iterative Closest Point algorithm to register dense depth maps obtained from a stereo vision system. The proposed technique expl...
متن کامل